Wireless surveillance system and method for 3-D visualization and user-controlled analytics of captured data

ABSTRACT

Systems and methods having a 3D model of a space provides a 3D context for the inputs from the ICDs; inputs from the ICDs, including direct cross-communication information, location, settings, environment conditions, and inputs (video, audio, temperature, other sensors), being visually represented on a GUI independently and in the 3D context for simultaneous display of all the info, and analytics based on the info, including activity density within the 3D context based on the inputs, for surveillance and analysis of target environment(s).

CROSS-REFERENCE TO RELATED APPLICATIONS

This non-provisional utility patent application claims the benefit ofone or more priority documents, namely: it is a continuation-in-partfrom U.S. patent application Ser. No. 11/520,117, No. 2007/0009104entitled Wireless Smart Camera System and Method filed Sep. 13, 2006;and U.S. Provisional Patent Application Ser. No. 61/068,003 filed Mar.4, 2008; both of which are incorporated herein by reference in theirentirety.

Also, this non-provisional utility patent application is related to oneor more prior filed co-pending non-provisional applications:

-   U.S. application Ser. No. 10/948,501, entitled “Wireless Video    Surveillance System and Method With Two-Way Locking of Input Capture    Devices,” filed on Sep. 23, 2004.-   U.S. application Ser. No. 10/949,487 entitled “Wireless Video    Surveillance System & Method with DVR-Based Querying,” filed on Sep.    24, 2004.-   U.S. application Ser. No. 10/949,609 entitled “Wireless Video    Surveillance System and Method with Emergency Video Access,” filed    on. Sep. 24, 2004.-   U.S. application Ser. No. 10/950,033 entitled “Wireless Video    Surveillance System and Method with Remote Viewing,” filed on. Sep.    24, 2004.-   U.S. application Ser. No. 10/949,489 entitled “Wireless Video    Surveillance System and Method with External Removable Recording,”    filed on. Sep. 24, 2004.-   U.S. application Ser. No. 10/949,776 entitled “Wireless Video    Surveillance System and Method with Dual Encoding,” filed on. Sep.    25, 2004.-   U.S. application Ser. No. 10/955,552 entitled “Wireless Video    Surveillance System & Method with Digital Input Recorder Interface    and Setup,” filed on Sep. 30, 2004.-   U.S. application Ser. No. 10/955,825 entitled “Wireless Video    Surveillance System & Method with Rapid Installation,” filed on Sep.    30, 2004.-   U.S. application Ser. No. 10/955,711 entitled “Wireless Video    Surveillance System & Method with Input Capture and Data    Transmission Prioritization and Adjustment,” filed on Sep. 30, 2004.-   U.S. application Ser. No. 10/955,444 entitled “Wireless Video    Surveillance System and Method with Single Click-select Actions,”    filed on Sep. 30, 2004.-   U.S. application Ser. No. 10/955,824 entitled “Wireless Video    Surveillance System and Method with Security Key,” filed on Sep. 30,    2004.-   U.S. application Ser. No. 10/977,762 entitled for Mesh Networking    filed Oct. 29, 2004.

FIELD OF THE INVENTION

The present invention relates generally to surveillance technology andequipment and, more particularly, to a wireless video surveillancesystem and methods associated therewith.

BACKGROUND OF THE INVENTION

While video surveillance systems have existed in the prior art,typically they are wired devices that are difficult, time-consuming, andcostly to install and operate. Also, generally, they do not provide forwireless systems that are secure from wireless interception or Internetenabled interception and permit remote user access for viewing,reviewing stored information, and controlling the system's components,in particular via Internet connection to a remote controller computer orcellular phone or other Internet connected device. Thus, there remains aneed in the art for a wireless surveillance system and methods ofoperating same, providing high quality input capture by surveillanceinput capture devices (ICD), including but not limited to video inputs,and digital input recorder device(s) (DIR) associated with the ICDs, theDIRs data transfer, storage, and control, including systems and methodsproviding for remote viewing and controls of the ICDs and DIRs via aremote server computer (RSC) and/or Internet access through the RSC,including 3-D presentation and management of the video inputs andanalytics.

Examples of Prior Art Include:

US Patent Application Publication No. 2007/0052807 published Mar. 8,2007 for System and Method for User Monitoring Interface of 3-D VideoStreams from Multiple Cameras provides integration of video stream frommultiple cameras but does not teach or disclose distinct association ofthe various inputs from the multiple cameras with each of the camerasthemselves, including location, settings, environment conditions, etc.While it provides for tracking a single moving object, it only providesfor tracking a single object—this includes the description aboutcontent-based analysis; and it only looks at abnormal activities, notnormal ones that occur at various times, when what you really need is anotification that the normal event has occurred and a correspondingaction needs to be taken.

US Patent Application Publication Nos. 2008/0192118, 2008/0291279, U.S.Pat. Nos. 6,144,375 and 6,919,921 provide for 3-D video mapping, videonavigation, user interface for 2-D control, visual activity maps derivedfrom the trajectories of motion of objects in an environment areprovided to “discover” interesting portions of data for “randomly”accessing corresponding portions of the media streams; this is formultimedia retrieval, not for live review and taking action from it.These do not all provide for object tracking, but those that do focus onsingle object tracking, not teaching collective activity that isrelevant to a target environment like retail, airport, etc.

US Patent Application publication no. 20040105006 published Jun. 3, 2004for Lazo, et al. assigned to Sensormatic Electronics Corp. for Eventdriven video tracking system, teaches a system that tracks andelectronically identifies assets from surveillance zone to surveillancezone within a controlled area is provided. A triggering event, which canbe the output of an RFID reader, or other event, initiates videotracking of the asset that is associated with the RFID tag or othertrigger. The video surveillance continues from zone to zone, as theimage of the asset is handed-off from camera to camera. The image of theasset can be selectively displayed and recorded, along with the identityof the asset. The system is flexible and programmable for use in aplurality of different environments and surveillance zones, using aplurality of different triggering sensors and video cameras.

U.S. Patent Application Pub. No. 20040136388 published Jul. 15, 2004,for Schaff, for Video-monitor/recording/playback system, describes astand-alone video recording, playback and Monitoring system. It hasnetwork switches, non-volatile storage devices, IP cameras, videoservers, and NTSC cameras. The system uses communication channels thatare WAN/LAN based and can be hard-wired or wireless.

U.S. Patent Application Pub. No. 20020186180 published Dec. 12, 2002,for Duda, William, for Hands free solar powered cap/visor integratedwireless multi-media apparatus, describes an apparatus whereby thefunctional electronics components of popular consumer communications andentertainment products can be repackaged in a molded plastic module thatwould be mounted underneath and follow the contour of the visor of ahead wearable cap/visor providing the user with a hands free, continuouspower, virtually invisible multi-media capability. The module wouldfeature, a drop down visual display, drop down camera lens for lowresolution digital photography, rechargeable battery, stereo speakersand earphones, a microphone and microphone boom, manual push buttoncontrols and LED indicator lights, input/output jacks, and aninteractive voice capability. A flexible solar cell and antenna would bemounted on the upper surface of the head wearable cap/visor providingthe wireless link and continuous power to the electronics module. Allcomponents would be secured to the head wearable cap visor via twoactive pins that protrude from the upper surface of the electronicmodule, pierce the visor, and mate up with the solar cell and antenna onthe upper surface of the visor.

U.S. Patent Application Pub. No. 20020026636 published Feb. 28, 2002,for LeComte, for Video interfacing and distribution system and methodfor delivering video programs, describes a video interfacing arrangementfor connecting at least one display device to at least one video sourcecomposed of a module including a dedicated and programmed digitalprocessing unit adapted to decode and descramble video flow according toa preloaded decoding or descrambling program, in order to display, inreal time or delayed in time, to store, to record and/or to send over atelecommunication network, and on at least one screen interface, atleast one storage or recording interface, a local or wide area networkconnecting interface and a user communication and controlling interface,the interfaces being linked to and driven by the processing unit andpreferably mounted in or on the module. The invention also concerns adistribution system and a method for transferring encoded video programsand sequences over a wide area network.

U.S. Pat. No. 6,335,742 issued Jan. 1, 2002, to Takemoto, for Apparatusfor file management and manipulation using graphical displays andtextual descriptions, describes a processor-based display processingapparatus, method and user interface allows for easy understanding ofthe contents of respective files by present a portion of the respectivefiles as a graphics image along with other associated attributes of therespective files. A computer readable recording medium with a programrecorded therein is provided for enabling a computer to function as theapparatus and perform the method. In the display processing apparatus,when an operator selects a folder from a folder display area on abrowser screen, a processor controls the selected folder to beidentified and displayed, and graphics images of image files containedin the selected folder are displayed in a predetermined display area.

U.S. Patent Application Pub. No. 20040008255 published Jan. 15, 2004,for Lewellen, for Vehicle video system and method, describes a vehiclevideo system includes a small camera in the passenger area that usesillumination in the non-visible spectrum to illuminate the passengerarea. The vehicle video system records video information on a digitalvideo recorder that uses digital media such as a hard disk drive,recordable CD (CD-R), rewritable CD (CR-RW), or writable Digital VideoDisc (DVD). The vehicle video system includes a local wirelessinterface, such as a Bluetooth-compatible interface, that automaticallyconnects to a compatible device in the parking area of the vehicle thatis coupled to a database. In this manner, the digital video informationcollected by the vehicle video system is automatically transferred tothe database when the vehicle is parked, removing the need for any humanintervention for the logging and cataloging of video tapes. The localwireless interface of the vehicle video system also allows otherdevices, such as a handheld device or a vehicle video system in adifferent vehicle, to access the stored digital video information.

U.S. Patent Application Pub. No. 20040165546 published Aug. 26, 2004,for Roskind, for Time based wireless access provisioning, describes amethod and apparatus for the time-based provisioning of wirelessdevices. A network access point monitors operation of wireless deviceswithin a service region. When provisioning logic is activated at thenetwork access point, the access point determines if the trackedparameter (such as power on or the onset of signal transmission) of thewireless device occurs within a designated time interval from the timeof the provisioning activation. If the tracked device qualifies, thenetwork access point proceeds with provisioning the device. In onesystem embodiment, the network access point tracks the power on time ofwireless devices. When a wireless device to be authorized is powered on,the provisioning logic at the network access point notes the power ontime. The user then activates the provisioning access at the networkaccess point, and the network access point provisions the wirelessdevice if it is recently powered on.

U.S. Patent Application Pub. No. 20030188320 published Oct. 2, 2003, forShing, for Method and system for a distributed digital video recorder,describes a system and method, for remote display and control of anaudio/video data stream from a capture device, e.g., a TV capture card,audio/visual capture card or digital camera capture card in a PC. In anexemplary embodiment there are some components of a software DVR playerexecuting on at least one client device and other components on at leastone server device. Users can view and/or control the audio/video datafrom a server device, having a capture device, on client devices locatedanywhere as long as they are connected to the server through a network.In addition, a server device with a capture device can support displayof the video data at multiple client devices at the same time.

U.S. Patent Application Pub. No. 20020188955 published Dec. 12, 2002,for Thompson et al., for Digital video recording and playback system fortelevision, describes a system and apparatus for digitally recording andplaying back videos from either an Internet website or a TV broadcast orcablecast is disclosed herein. The system comprises a set-top box, alongwith the necessary cables and remote control units, that connectsbetween a television set and an Internet hook-up and allows a viewer todigitally record TV shows and/or download video from the Internet andstore said video on the set-top box's hard drive for later viewing(using video encoding technology). In addition to the recording andplayback capabilities, the disclosed system allows the viewer to pause,rewind, slo-mo, and instant replay live television without videotapes orVCR programming.

U.S. Patent Application Pub. No. 20040168194 published Aug. 26, 2004,for Hughes, for Internet tactical alarm communication system, describesan Internet tactical alarm communication (ITAC) system includes at leastone sensor, at least one video camera, and an ITAC computer deliveryunit, wherein the at least one sensor, the at least one video camera,and the ITAC computer delivery unit are communicatively interconnected,and the ITAC system provides real-time data regarding a particularcondition.

U.S. Patent Application Pub. No. 20020100052 published Jul. 25, 2002,for Daniels, for Methods for enabling near video-on-demand andvideo-on-request services using digital video recorders, describes anear video-on-demand (VOD) service enabled using a digital videorecorder (DVR) for the simultaneous storage and playback of multimediadata. A DVR is connected over a network to a multimedia network source.A VOD selection is requested by the DVR from the network source. Amultimedia data signal is received by the DVR from the network source.The data signal contains the requested VOD selection. A first receivedportion of the received data signal is stored on the DVR. The firstreceived segment is played by the DVR for display on a display device.Simultaneously during the playing of the first received segment, asecond received segment of the received data signal is received from thenetwork source and stored on the DVR while the first received segment isplayed the display device. Thus, the requested VOD selection beginsplaying on the display device prior to the reception of the entirecompressed multimedia data signal so that a requested VOD selection canbegin being displayed nearly instantaneously after the request for it ismade. A video-on-request (VOR) service is also enabled using a DVR. VORselection data is received by a centralized database device, such as anetwork server, from a plurality of users. Each VOR selection dataincludes at least one requested video selection and video recorderidentifying information for identifying each particular video recorder.A transmission priority of requested video selections is determineddependent on the frequency of requests .sup.1received from the pluralityof users. A transmission channel and time is determined based on thetransmission priority. DVR control signals are transmitted toautomatically tune in the determined transmission channel at thedetermined transmission time and record the particular video selection.

SUMMARY OF THE INVENTION

The present invention is directed to a wireless surveillance system andmethods of operating same, providing simple setup and controls for highquality input capture by surveillance input capture devices (ICDs) thatare capable of cross-communication with each other, including but notlimited to video inputs, and digital input recorder device(s) (DIR)associated with the ICDs, the DIRs data transfer, storage, and control.More particularly, the present invention provides a wireless smartcamera system and methods of using the same, including a 3D model of aspace provides a 3D context for the inputs from the ICDs; inputs fromthe ICDs, including direct cross-communication information, location,settings, environment conditions, and inputs (video, audio, temperature,other sensors), being visually represented on a GUI independently and inthe 3D context for simultaneous display of all the info, and analyticsbased on the info, including activity density within the 3D contextbased on the inputs, for surveillance and analysis of targetenvironment(s). The present invention systems and methods includeproviding for remote viewing and controls of the ICDs and DIRs via aremote server computer (RSC) and/or Internet access through the RSC, thesystems and methods having controllable communication between the ICD(s)and corresponding DIR.

In a preferred embodiment, there is at least one ICD associated with acorresponding DIR for providing a system for capturing inputs of atarget environment via the at least one ICD and transferring thoseinputs via two-way controllable wireless communication with the DIR forelectronic, digital storage and remote access thereof. In anotherpreferred embodiment, the system further includes an RSC, which isdirectly or Internet-remotely accessed by at least one authorized userof the system, when control settings permit. Such controllable remoteaccess includes user viewing of captured inputs of the targetenvironment, including live and/or historical/recorded data, storing,editing, retrieving or otherwise reviewing said inputs, and controllingthe system settings and activities, and combinations thereof.

The present invention is further directed to a method for installing andoperating the system and various embodiments and combinations thereof.Thus, the present invention provides systems and methods for wirelesssurveillance of predetermined environments, in particular with remoteaccess and controls of the system components.

Accordingly, one aspect of the present invention is to provide a systemfor surveillance of a predetermined environment having at least onewireless input capture device (ICD) and a corresponding digital inputrecorder (DIR) for receiving, storing, editing, and/or retrieving inputsfrom the at least one ICD and analytics associated with the inputs viainteractive 3-D graphic user interface (GUI) viewable by a remote userof the system.

Another aspect of the present invention is to provide a system forsurveillance of a predetermined environment having at least one wirelessinput capture device (ICD) and a corresponding digital input recorder(DIR) for receiving, storing, editing, and/or retrieving stored inputfrom the at least one ICD and controlling the ICD, and a remote servercomputer (RSC) for providing at least one authorized user remote,wireless access to the at least one ICD and DIR, where the ICD, DIR, andRSC are in wireless digital communication with each other and where theRSC may be accessed directly by the user or through the Internet viainteractive 3-D graphic user interface (GUI) viewable by a user of thesystem.

Still another aspect of the present invention is to provide methods ofusing the system embodiments set forth herein, such as a method forproviding communication between at least one wireless input capturedevice ICD(s) and a corresponding digital input recorder (DIR),including the steps of providing base system; at least one useraccessing the DIR via user interface either directly or remotely; theDIR searching for signal from the ICD(s) and establishing communicationwith them; and captured data being represented visually on a userinterface for the user, the screen views showing 2-dimensional data andcorresponding 3-dimensional data of the same input capture withcoordinate overlay to provide a geographic context for the captureddata.

These and other aspects of the present invention will become apparent tothose skilled in the art after a reading of the following description ofthe preferred embodiment when considered with the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view of one embodiment constructed according tothe present invention.

FIG. 2 is a side view of the embodiment shown in FIG. 1.

FIG. 3 is a front view of the embodiment shown in FIG. 1.

FIG. 4 is a back view of the embodiment shown in FIG. 1.

FIG. 5 is a top view of the embodiment shown in FIG. 1.

FIG. 6 is a bottom view of the embodiment shown in FIG. 1.

FIG. 7 is a schematic showing the interconnection of remote units of thesystem.

FIG. 8 is a user interface view of inputs to the system viewable by auser.

FIG. 9 is a schematic showing communication between ICDs that thencommunicate with a DIR that then communicates with a RSC.

FIG. 10 is a schematic showing communication between ICDs that thencommunicate to a cell tower which then communicates to a RSC via theinternet.

FIG. 11 is a schematic view showing network communication operabilityand screen views for the present invention.

FIG. 12 shows a user interface screen viewable by a user with2-dimensional data and corresponding 3-dimensional data according to thepresent invention.

FIGS. 13-15 provide perspective views of video analytics display on avideo surveillance camera device, in accordance with an embodiment ofthe present invention.

FIGS. 16-20 show perspective views of the data analytics managementsystem for video surveillance information, including remote displayscreen shots illustrating contextualization features.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following description, like reference characters designate likeor corresponding parts throughout the several views. Also in thefollowing description, it is to be understood that such terms as“forward,” “rearward,” “front,” “back,” “right,” “left,” “upwardly,”“downwardly,” and the like are words of convenience and are not to beconstrued as limiting terms.

Referring now to the drawings in general, the illustrations are for thepurpose of describing a preferred embodiment of the invention and arenot intended to limit the invention thereto. As best seen in FIG. 1, thetwo base elements of a system constructed according to the presentinvention are shown side-by-side, including a wireless input capturedevice and a corresponding digital input recorder.

FIG. 1 shows a perspective view of one embodiment constructed accordingto the present invention, showing an input capture device (“ICD”),generally referred to as 30, and a digital input recorder (“DIR”),generally referred to as 10, juxtapositioned. The DIR 10 has a plasticcase 11 with a metal plate 12 affixed thereto and a removable tiltadjustable base 13 removably attached to the bottom of the DIR. Antennas14, near the top of the DIR provide wireless communication for thepresent invention. A green power led and button 15 is near the top ofthe DIR. The button 15 can turn on the motion detection and/or recordall functions of the present invention. The status indicator LEDS 26 areplaced on the front of the DIR and can illuminate either red or green.

Similarly, the ICD 30 has a plastic case 31 with a metal plate 32affixed thereto and a removable tilt adjustable base 33 removablyattached to the bottom of the ICD. Antennas 34, near the top of the ICDprovide wireless communication for the present invention. A power/motiondetection LED 35 is positioned near the bottom of the front of the ICDand can illuminate either red or green. A microphone 36 is alsopositioned on the front of the ICD to detect sound. The camera lens 37is positioned near the top front of the ICD. An infrared (IR) or lasersensor 38 and IR or laser transmitter 39 are also shown on the housingof the ICD.

FIG. 2 shows a side view of the embodiment shown in FIG. 1, showing anICD 30 and a DIR 10 juxtapositioned.

FIG. 3 shows a front view of the embodiment shown in FIG. 1, showing anICD 30 and a DIR 10 juxtapositioned. An infrared (IR) or laser sensor 38and IR or laser transmitter 39 are also shown on the housing of the ICD.

FIG. 4 shows a back view of the embodiment shown in FIG. 1, showing anICD 30 and a DIR 10 juxtapositioned. The ICD 30 has air vents 41 tofacilitate cooling of the device. FIG. 4 also illustrates the variousports that are available on the two devices. The ICD 30 has thefollowing ports: RJ-45 42; Alarm I/O Out 43; Microphone In 44; RCA VideoOut 45; and DC In 46.

Similarly, the DIR 10 has air vents 21 to facilitate cooling. Some ofthe ports may differ between the ICD and DIR. The DIR 10 has thefollowing ports: RJ-45 22; Alarm I/O Out 23; Audio Out 24; RCA Video Out25; DC In 26; and USB 27.

FIG. 5 shows a top view of the embodiment shown in FIG. 1, showing anICD 30 and a DIR 10 juxtapositioned. This demonstrates the possiblefootprints of the devices.

FIG. 6 shows a back, side, and front view of an alternative embodimentof the ICD 30 component of FIG. 1. The ICD 30 is similar to thatpreviously described except the air vents 41 have been removed and theantennas 34 have been positioned to the back of the ICD. Additionally,FIG. 6 illustrates the ICD with the removable tilt adjustable base 33removed.

FIG. 7 shows a schematic showing the interconnection of remote units ofthe system.

FIG. 8 shows a user interface view of inputs to the system viewable by auser.

FIG. 9 shows one mesh networking scheme according to the presentinvention. In one embodiment, ICDs communicate with each other to 1)extend the range of the ICDs, so they transmit data to pass down theline to the receiver, extending the range by the number of cameras and2) cameras communicate with each other based on set rules and decidethemselves when an issue should be made aware of to the DIR or RSC. Byway of example, one camera can alert another camera if it picks up afast moving person who is running towards that camera; if a personshould not be at that camera, it can then alert the DIR or RSC.

Alternatively, ICDs can communicate with each other to exchange RFIDdata that each ICD receives and then, based on rules that each camerahas, act on that data. By way of example, if an ICD detects a person whohas an RFID tag, the ICD can also detect that person's RFID data andcompare it to a database to determine if that person has permission tobe at a certain location. Furthermore, the system also can track aperson's movement. If a person appears with the incorrect RFID tag or noRFID tag, then an alarm can be sent to other ICDs and/or the DIR whichcan in turn communicate with the RSC.

FIG. 10 shows another mesh networking scheme according to the presentinvention. In one embodiment, ICDs communicate with each other based onset rules and decide themselves when an issue should be made aware of toRSC via a cellular connection. The ICDs send data to one another and inan alternate configuration just send data to the RSC via the cell towerand the RSC sends data back to each ICD. By way of example, one cameracan alert another camera if it picks up a fast moving person who isrunning towards that camera; if a person should not be at that camera,it can then alert the RSC.

The wireless surveillance system according to the present inventionincludes at least one wireless input capture device (ICD) for sensing,capturing and transmitting surveillance inputs from a predeterminedinput capture location, and a digital input recorder device (DIR) forreceiving the surveillance inputs from the at least one wireless ICD andstoring those inputs, which are capable of being reviewed by a systemuser on a controller/server computer, wherein the server computer isoptionally used for communication with the ICDs and DIRs. In oneembodiment of the present invention, the at least one ICD andcorresponding DIR device are used to form the system without requiring aseparate server computer. The DIR itself has full capabilities whenarranged for communication wirelessly with ICDs for recording andcontrolling inputs to the system, as well as settings for each of the atleast one ICD, including activation of each.

Input Capture Device(s) (ICDs)

On the front end of the system, the at least one wireless ICD furtherincludes a power source, a power converter; soft power down componentwhich provides for a gentle power down so that ICD settings arepreserved and not lost. Preferably, while the ICD is wireless, itfurther includes an optional network connection at a back side of theICD also, so it can be hardwired into a network.

The ICD also includes at least one sensor and at least one inputcomponent for detecting and recording inputs, a processor, a memory, atransmitter/receiver, and optionally, at least indicator light forindicating camera activities, all constructed and configured inelectronic connection. By way of example and not limitation, the atleast one input component may include a microphone, and/or a camera. Inone preferred embodiment of the present invention, the at least onewireless ICD includes two antennas for providing a wireless signal forreceiving and/or transmitting data with the DIR device or anotherICD(s). The ICDs are operable for cross-communication with each other,including data exchange, wherein the data exchange includes informationabout the surveillance environment, settings, inputs, and combinationsthereof. The at least one wireless ICD further includes a housing havinga removable casing around the lens to make lens adjustments or settings;ICD adjustments and settings are preferably optional, and are notusually required in preferred embodiments of the present invention, asthe DIR device automatically establishes and controls the ICD settingsand activities for each of the at least one wireless ICDs associatedwith the particular DIR device.

For the preferred embodiments where the ICD includes a digital videocamera (DVC) having a lens and corresponding camera components, thecamera further includes a computer chip providing for capabilities ofperforming video compression within the ICD itself. The ICD as awireless digital video camera is capable of capturing video within itsrange within the surveillance environment and compressing the capturedvideo into a data stream, the capture occurring at predetermined datesand times, during activity detection, and/or on command from thewireless DIR associated therewith. In the case of video, the images areadjustable to capture at different sizes, different frame rates, and/orto include the display of the name of the device (determined by the userand/or the system), the date, the time, and combinations thereof. TheICD including a DVC is capable of capturing images that are combinableand/or integratable with the video data stream and/or compressible intoan individual image data stream, all at predetermined dates and times,when activity such as motion or audio are detected, on command from thewireless DVR, and combinations thereof. As with video capture, imagecapture is adjustable to capture at different sizes, different framerates, and/or to include the display of the name of the device(determined by the user and/or the system), the date, the time, andcombinations thereof. A data stream of images is transmittablewirelessly to the wireless DVR.

Similarly, where the at least one ICD has audio capabilities, thecaptured audio, which is combinable and/or integratable with otherinputs captured by the ICD sensors, is compressible into an individualaudio data stream, which is transmittable wirelessly to the DIR. Theactivity of audio ICD is activatable at predetermined dates and times,during activity detection, and/or on command from the wireless DIRassociated therewith. The audio ICD is further adjustable to captureaudio at different or variable rates.

Preferably, since the ICD generates heat during operation, the ICDhousing includes a cooling system having a vent and a low noise coolingfan. Since the video components of ICDs generate heat that must bedissipated for optimal performance of the system, preferred embodimentsof the present invention include housing units with components thatoperate at lower temperatures, i.e., which generate less heat duringoperation, and include housing units formed of materials that dissipateheat well, and may include a combination of materials, such as metalsand synthetic plastics or composites. While ICDs are preferably used forindoor applications, waterproofing and weather proofing housing unitsand other components for sealing the housing against water and weatherare used for outdoor applications of the present invention. By way ofexample, sealed or gasketed casing, weatherproof venting and fancomponents to prevent water blowing into or being sucked into the case,are used for outdoor ICD units.

Other components optional to the housing unit but preferred for ease ofuse of the system include a removable filter collar on a front end ofthe camera lens, which facilitates user access for changing the filterand/or to provide a different filter, such as a polarization filter or aspecialty filter, for example, to reduce light input or camera aperture.

The ICDs of the present invention are capable of detecting motion,capturing video, detecting and/or capturing audio, providing at leastone data stream capability, including video, compressed video, audio,and combinations thereof. The at least one ICD is capable of capturingvideo, which is compressible into a data stream, and transmittablewirelessly to the DIR device, with the ICD audio data or other inputdata, such as temperature, humidity, chemical presence, radiation, andother input data, depending upon the sensors and intake means of eachICD, being combinable and/or integratable with the video data stream.Thus, while the ICDs each include at least one sensor for detection andat least one capture input means, preferably each of the ICDs include atleast two sensors and input means for image and/or video, and audiocapture. In a preferred embodiment, at least two sensor types are used,audio and image or video sensors. The at least one indicator is includedwith the ICD to indicate that the power is “on”, and to indicate thatmotion and/or audio being detected. The indicator is activatable whenmotion and/or audio is detected in a predetermined area and/or in apredetermined amount within the environment.

Each of the at least one ICDs is constructed for configuration that iscapable of wireless communication (2-way) with the corresponding DIRdevice and/or any other ICD(s), which when configured provide a systemfor wireless electronic surveillance of an environment. In a preferredembodiment of the present invention, the ICDs are provided with multipleinput multiple output (MIMO) wireless capability. Other wirelesscommunication may be provided instead of MIMO.

Night vision for ICD video input capture may be provided using aninfrared (IR) light source, so that the video recorded may be effectivein low- to no-light conditions. Image or video input capture may beprovided in a range of resolution, in black/white, in color, and sizedbased upon inputs from the DIR device and/or controller/server computerby an authorized user of the system, and are modifiable after setup ofthe system by modifying controls remotely, and/or by modifying hardware.

The ICD further includes at least one chip that makes the device anintelligent appliance, permitting functions to be performed by the ICDitself without requiring software installation or the DIR, including butnot limited to sensor and input controls, such as camera digital zoom,pan left and right, tilt up and down; image or video brightness,contrast, saturation, resolution, size, motion and audio detectionsettings, recording settings, communication with other ICDs; and singlechip video compression (single DSP). The ICD also includes a sensor withability for high dynamic range for inputs. Preferred embodiments of asystem according to the present invention includes video technologycommercially provided by PIXIM, and set forth under U.S. Pat. Nos.6,791,611; 6,788,237; 6,778,212; 6,765,619; 6,737,626; 6,726,103;6,693,575; 6,680,748; 6,665,012; 6,552,746; 6,545,258; 6,542,189;6,518,909; 6,507,083; 6,498,576; 6,498,336; 6,452,152; 6,380,880; and6,310,571.

The ICD further includes a stand to support the device; the stand may beincluded with, integral with, or attached to the housing. The stand isconstructed and configured to be mountable to a wall, suspend fromceiling, and provide a variety of stable positions for the ICD tocapture as much data from a given environment as appropriate, given thespace, conditions, and input capture type desired. Importantly, thestand serves as a stable base to tilt the ICD for camera direction upand down, and/or side to side. The stand is movable between positionsbut retains a fixed position by a predetermined friction to ensure sothat the ICD stays in place wherever the positioning was last stopped.The base and stand of the ICD is constructed such that it does notrequire mounting to a surface to provide stability. The adjustabilityand mobility of the device are significant features of the presentinvention to ensure optimal surveillance and easy setup.

Furthermore, the stand is weight balanced for good center of gravity tosupport the adjustment on the stand for stability on the entire range ofmotion for the ICD on its stand; since motion of the ICD is adjustableand provides for dynamic range of motion when the ICD is in use, thestand construction enables remote modification of settings withoutrequiring the user of the system to readjust or optimize the ICDpositioning in person.

The ICD preferably is constructed and configured for a range ofcoverage, which can vary depending upon the conditions and limitationsof a particular target environment. In a preferred embodiment of thesystem, the ICD has a range of coverage with a target range of at leastup to 250 ft. The ICDs are capable of having a range of up to 300meters, with an active wireless range from 1-1000 ft linear feetindoors, and preferably greater. Advantageously, the ICD can beconfigured and activated quickly for quick start up of a surveillancesystem in the target environment. Additionally, the ICDs have theability to communicate with one another to act as a data repeater andextend the usable wireless range to 3,000 meters and more.

Significantly, no adjustments to camera settings, such as focus andfocal length, are required after camera installation; ICD settings arepreadjusted and further controllable remotely by the DIR and/or RSCand/or other ICD(s). By contrast, in the prior art, adjustments areusually always required for surveillance cameras following installation.Preprogrammed settings may be provided, with automatic and remoteadjustment capabilities. Where the ICD is a video camera, the settingsmay include focus, resolution, etc.

Each of the at least one ICD is constructed to optimally reduce heatfrom particular heat-generating components. In a preferred embodiment ofthe present invention, the ICD includes a plastic case with metal sidesto reduce heat while the system is running. Also, a back plate of theICD or camera is all metal to increase heat dissipation, and to optimizeweight and heat management, which important where there is a lot ofpower involved, as with wireless video input devices. Also,significantly, the ICDs and/or DIR devices are constructed with aseparate chamber for imaging components to reduce heat. It is known thatheat is not good for imaging sensors or equipment; however, cooling fanscan generate noise, which is preferably minimized with security systemsand components therein. The camera is configured to communicate with animaging board with a flexible electronics communication cable, whichpermits the camera to have a separate chamber for optimized heatreduction. This is a problem specific to wireless cameras that has notbeen successfully addressed in the prior art.

The ICD also includes at least one and preferably two antenna that areremovable, including standard antennae, which may be substituted for apatch antenna and/or a long range antenna.

The inputs captured by ICDs are provided to the DIR for which output forRCA viewing is available, such as connecting a monitor with a userinterface for remote viewing of video from video cameras. In this casethe setup easier because the remote user can see what the camera viewsfrom the monitor, which is removably connectable to the system. The ICDand DIR also have an optional network connection at the back side, sothe devices can be hardwired into the network, if appropriate; however,wireless connections are preferred.

Additionally, the ICDs have inputs, such as video and microphone, and atleast one indicator light. In the case of a wireless video camera, thehousing includes an easily removable casing around the lens to make lensadjustments or settings, which optional, and not usually required.

Additionally, the ICDs have the ability to communicate with one anotherto exchange data about the environment and all control settings andother settings of any other ICDs.

Digital Input Recorder Device (DIR Device)

The DIR is an optional component of the system where ICDs have smartmicroprocessing capabilities that enable data input capture, inputsprocessing and comparison with settings and/or reference data, andcross-communication with each other. However, where used, the wirelessDIR device communicates directly with the at least one ICD, and, inembodiments where the controller/server is included in the system, theDIR device also communicates with the controller server to send datastreams to the server and receive data or instruction from thecontroller/server to control its properties. In the case of a videocamera for at least one ICD, the DIR may also be referred to as adigital video recorder device (DVR).

Surprisingly, compared with prior art surveillance systems, the DIRdevice and the smart ICDs function as appliances, which permits a rapidsetup of the system. Significantly, since the DIR device operates as anappliance, there is no software installation involved in the basicsystem setup. The preferred embodiments of the present inventionincluding at least one ICD and a corresponding DIR device permit forsetup and recordation of inputs to the system from the observation orsurveillance environment with one click activation by theuser/installer, generally in less than ten minutes from start to finish.Such rapid setup, including installation and activation to recording ofthe system, is not possible with prior art systems, given their complexcomponents, interactivity via transmission lines, and/or softwareinstallations, which typically require an expert or trained specialistto ensure proper setup, installation, activation, and testing of thesystem prior to ongoing operation. By sharp contrast, the preferredembodiments of the present invention provide for one click activationfor receiving and recording inputs to the at least one wireless ICD,i.e., for activating the ICD capability to record designated dates andtimes, when a surveillance event, a motion event or an audio event isdetected by at least one of the at least one ICDs in the system,immediately after the rapid setup is complete.

Furthermore, the system provides for rapid settings adjustment,including settings for sensitivity of ICD motion and audio detection;preferably, the settings adjustment is made by the user through the DIRdevice. The user simply sets a surveillance area for observation anddata capture by each ICD of the at least one wireless ICD; for videocapture, using an ICD with a digital camera, the camera may be set tofocus on a predetermined location within the area, such as a window, adoor, and the like. While the settings are practically a function of theICD itself, the DIR device, which is also wireless, functions to controlthe settings of each of the corresponding ICDs associated with that DIRdevice. Other functions performed by the DIR device include, but are notlimited to printing, saving or storing recorded inputs from the ICDs,transferring data to a removable storage device, such as a USB storagekey device.

Also, a power supply and a soft power down function is provided, similarto the ICD soft power down, to preserve the settings of the DIR devicein the event of power termination to the device.

The DIR is capable of running software for managing input from the atleast one wireless ICD associated with or corresponding to a particularDIR device after installation. With the software, the DIR is capable ofintaking and managing up to 10 data streams simultaneously; allowing theuser to control the ICD unit, including allowing the user to zoom, pan,and tilt the camera, as well as managing microphone sensitivity.Sensitivity controls for other ICD input means, such as heat ortemperature, chemical substance presence, radiation detection, and thelike may be controlled remotely from the wireless DIR device as well.Other DIR device control functions for controlling the ICDs include butare not limited to controlling brightness, contrast, color saturation,where images and video are involved.

Other software-based functions capable of being performed by the DIRinclude sending text message, sending still image, sending email orother communication to a user on a remote communications device;usually, these functions are programmed to occur upon the occurrence ofan event. DIR data recordation and storage overwrite may be based onsettings that enable newer data to overwrite older data. Additionally,the DIR may be programmed to include overwrite protection to preventoverwriting of event video, audio, or other input data captured by theICD and transmitted to the DIR device. Preferably, the DIR includescapabilities of data search and display, data archiving to externaldevice, network, computer, server, and combinations thereof, dataprinting, data exporting, data deletion, data playback, and combinationsthereof. Data playback includes play, fast forward, rewind or reverse,frame by frame step forward or backward, pause, and combinationsthereof.

In a preferred embodiment of the present invention, the system includesa DIR device running software that is capable of automatically upgradingits own software, which eliminates user maintenance, upgrading, or otheractivity to optimize system performance.

The DIR's capabilities of adjusting settings and/or controls for the atleast one ICDs includes any functions of the ICDs, including but notlimited to zoom pan and tilt, color brightness, contrast, saturation,sharpness, frame rate, video and/or image size, audio rate, wirelesscontrol data, encryption and security data, set motion and/or audiodetection area and/or levels, set recording, set triggers, record oncommand, and combinations thereof.

The DIR is preferably capable of connecting directly to a computer or acomputer network, more specifically connecting to a personal computervia a USB or similar connection and to a network using a network cableor similar connector, with the DIR interface being accessible after suchconnection through a user interface or a web browser, respectively; andcapable of sending data and/or alert or warning to a cell phone orcomputer via a signal or message such as by voice or email.

Also, the DIR is capable of performing a backup of the ICD inputs,including video, to a network, a personal computer (PC), computerreadable medium (CRM) or other storage device. The DIR may be programmedto lock to predetermined ICDs having cameras, to maintain integrity ofcamera signal to DIR device.

In a preferred embodiment of the present invention, the user interfaceof the ICD inputs on the DIR device include at least one visual cue onthe video to tell whether video is being recorded, e.g., a red and/orgreen dot is shown on the image. Also, preferably, the DIR device has afront with indicator lights that match or correspond to these samevisual cues. For quality checking purposes, similarities such as theseprovide ease of use for the system user to confirm system functionalityupon inspection.

The DIR device is programmable for wireless communication with inputcapture device, including both transmitting data, settings, controllinginstructions and receiving input captured from the ICD, like images,video, audio, temperature, humidity, chemical presence, radiation, andthe like. Thus, the DIR device is capable of receiving wireless datafrom the wireless input capture device(s), indicating which of the ICDsis active, recording data and storing data, searching through recordeddata, transmitting data and instructions to the ICD, adjusting ICDsettings and/or controls, communicating with the controller/servercomputer to send and/or receive data, and other functions, dependingupon the specifications of the system setup, the environment undersurveillance, and whether or not remote access is used via thecontroller/server computer and Internet.

The DIR device's data recordation and storage capability permit inputsfrom a multiplicity of ICDs to be associated with each DIR device to besingularly received, recorded, stored, and researched by a remote userfrom the ICDs. The user can search historically recorded data by date,time, event type, or any other means of selecting a setting or eventcorresponding to the each or any of the ICDs and the environment undersurveillance by the system. Each of the ICDs is capable ofindividualized settings control by a single DIR device; a multiplicityof DIR devices may be controlled and managed by the controller/server,either within a given surveillance environment or in differentlocations.

Other components of the DIR device include, but are not limited tohaving a base that may be optionally adjustable for optimized mountingon a surface; having a long range MIMO wireless component; having aone-chip video compression component for resizing video data,recompressing it, and streaming it; having a USB port connectable to acomputer, or for storage key, or removable hard drive for data storage;having an ethernet port to connect to a network; having RCA video outputlike the ICDs; having 2 or 3 USB ports for data output as well as for aUSB based security key, having at least one antenna, preferably threeantennae, which may be removable and replaceable; having a power controlbutton on the housing; having a recessed reset button in the housing,accessible on the backside of the housing; having a low noise fan;having a hard drive for recording inputs; and/or having at least one,preferably a multiplicity of indicators, preferably light emittingdiodes (LEDs), that are viewable by a user on the outside of the housingof the DIR device.

By way of example, in a preferred embodiment of the present invention,the DIR device has ten LEDs on the front of the housing, each of whichcorrespond to an individual ICD. Significantly, these indicators, inparticular as LEDs, provide content dense visual information with aquick glance from the user. There are five modes that represent ICDstatus, illustrated for one embodiment in the following table, Table 1:

LED INDICATOR CORRESPONDING STATUS Off ICD off Green ICD connected toDIR device Flashing Green DIR recording inputs from the ICD Flashing RedICD detecting at least one event Red Error warning

The error warning may be due to a variety of conditions, such as, by wayof example and not limitation, lost connection between the ICD and DIRdevice, data loss, throughput reduction, etc.

The optional remote controller or server computer (RSC) runs softwareproviding for remote access and control, and is separate from thewireless DIR and the ICDs. Users log in with a username and passwordfrom any Internet connected PC, web enabled cell phone, or otherInternet enabled or network communicable device, to remotely access orreview the wireless input or camera video and/or image(s). The useraccesses the system through a user interface operating in connectionwith a web browser. The RSC communicates directly with the wireless DIRand enables users to remotely configure wireless DIR properties and theICDs' properties, and, preferably to perform any of the functions thatare directly performable for any DIR or ICD, such functions being setforth in the foregoing. The RSC may provide an electronic commercefunction such as providing a user to pay for remote access service. TheRSC provides an authorized user remote from the target surveillanceenvironment the option of logging into the system, selecting any ICD formonitoring, e.g., select any camera input from any DIR, print, save,email image from the input, such as a video clip, and zoom, pan and tiltlive video through the DIR, similar control and/or access activities,and combinations thereof.

The RSC functions as a remote monitoring station like a personalcomputer and is capable of providing a user interface that is accessiblethrough a web browser; the RSC is thus any Internet connectable device,including computer, PDA, cell phone, watch, any network accessibledevice, and the like, which provides access for at least one remoteuser. The at least one remote user is preferably a predetermined,authorized user.

Users of the system are preferably authorized, whether access is director remote. Apart from direct access, authorization may also determinelevels of access for each user. While all capabilities of the DIR andICDs are controllable remotely, either by the DIR itself or by anInternet communicable device in communication with a server computerthat communicates with the DIR(s), the number and type of devices may belimited based upon authorization level of a user.

The RSC provides for user remote access to live and/or recorded audioand/or video for any camera on any DVR; furthermore, control functionspermit this user(s) to

adjust and to make changes to any DVR or ICD settings remotely. Also,off-line archiving is operable via the user selecting to remotely recordto the RSC.

DIR and ICD Communication Locking

In one embodiment of the present invention, a method for lockingcommunication between at least one wireless input capture device ICD(s)and a corresponding digital input recorder (DIR) or other ICD(s), eitherone-way and/or two-way, is provided, including the steps of providingbase system; at least one user accessing the DIR via user interfaceeither directly or remotely; the DIR and/or ICD(s) searching for signalfrom the ICD(s) and establishing communication with them; and lockingthe ICDs to send wireless data exclusively to that DIR or ICD; and/orthe DIR or ICD locking itself for exclusive communication with thelocked ICDs, thereby providing a secure surveillance system for a targetenvironment.

DIR Activation and ICD Searching

The ICD is activated when at least one user accesses the DIR software byeither launching the software directly or launching the DIR device or byclicking on an activation or start button for triggering activity stepswithin the software and hardware system to activate communicationincluding data exchange between predetermined DIRs and theircorresponding selected ICDs. In a preferred embodiment of the presentinvention the at least one ICD includes a wireless digital camera andthe corresponding DIR is a DVR; however, one of ordinary skill in theart will appreciate that the functionality applies to a range of ICDsand corresponding DIRs, with or without video capabilities in each case.When any of these events occur, the DVR initiates checking for signalsfrom prior configured capture devices. If the DVR starts without anyprior configured capture devices, then the DVR automatically beginssearching for wireless signals from capture devices. If the DVR startswith prior configured capture devices and the user wants to addadditional devices, the user clicks on a search button, and the DVRbegins searching for wireless signals from capture devices not alreadyconfigured and communicating with the DVR.

Communication

In a preferred embodiment of the present invention, the DIR is operableto identify signal(s) from the at least one ICD corresponding thereto,and the DIR automatically establishes communication with the identifiedcapture device and creates a named representation, such as an icon orimage with a name that represents the active ICD. Also, the DIR isoperable to create a named representation for each of the correspondingICDs associated with that DIR that are identified but not in activecommunication with the DIR at that time. The non-communication status ofthese devices is denoted in the representation, for example by at leastone indicator having at least one status, as set forth in the foregoing(see, e.g., Table 1). Then, the wireless digital video camera as ICD isoperable to send a still image to the DIR interface, where applicable,for the user to confirm identity of the ICD sending the image.Importantly, the smart cross-communication of the ICDs permits inputsprocessing, comparison, recording, and combinations thereofindependently of the RSC or DIR. The user may rename the ICD at thattime or at a subsequent time. Importantly, no additional user steps arerequired to establish the monitoring set-up.

Camera Validation/Communication Optimization

The DVR is further operable to validate the device approval status forcommunication with the specific DVR and optimizes the wireless signal tothe DVR to ensure the greatest information throughput.

Camera Locking/Security Establishment

Preferably, security functionality is operable when a DIR automaticallylocks a specific ICD, such as to permit sending wireless data only tothat specific DIR and automatically initiating security on the datastream. The security methods may include cryptographic methods such asdigital signing, stream cipher encryption, block cipher encryption, andpublic key encryption or hardware based encryption in which each devicehas a hardware device for encryption included. By way of example and notlimitation, WAP, 802.11i, AES, SSL, stream cipher, any other type ofsecurity protocol, and combinations thereof may be used.

DIR Locking

Any of the DIRs operable within the system and having at least one ICDassociated therewith are further operable to be locked to preventsetting changes or data manipulation from any device apart from the DIRwith which each ICD is locked into communication. In one embodiment ofthe present invention having video capabilities, the DVR as DIR, uponconfirming detection of all the signal(s) from ICD(s) associatedtherewith, confirms the establishment of communication with eachdetected ICD, in particular wireless digital video camera, and locks theDVR to only communicate with the found device(s), unless it receivesinstruction from the user to look for other signal(s). The DVR indicatessuch a locked status, for example, by displaying a lock indicator on theDVR and/or on the ICD to provide an external visual status indicationthat the ICD(s) are locked and also sends a lock status signal to anentity outside the present system, such as to the RSC and/or an alarmsystem or security software. Once searching and locking is complete, theDVR will not accept signals from capture devices that are not locked tothe DVR, unless directed to search for capture devices by the user byclick-selecting the search button 210. Alternatively, the system cannotify the user of new ICDs that come into communication with the systemduring operation and/or after initial setup has occurred.

Camera Removal

ICDs may be removed from operation and/or operational communication orinteraction with the system. To remove a capture device from the DVRsystem, the user click-selects from the user interface on an imageand/or name that represents the capture device they want removed andthen click-selects a single removal button. The DIR then removes thatcapture device from the system.

Smart Mesh Camera Networking with Video Content Management

In one embodiment of the present invention, the system includes a smartmesh ICD networking with a video content management. The smart mesh ICDnetwork of the system is operable to provide ICDs to communicate witheach other and/or the wireless DIR to act as repeaters, i.e., anextension or repeat functional component, to extend the usable range ofthe system beyond the range of any individual ICD. Thus, by way ofexample where the standard range of the wireless DIR to a ICD is 200ft., using a smart mesh ICD and system according to the presentinvention provides that a ICD 600 ft. away from the DIR is operable tosend a signal to another of the multiplicity of ICDs having digitalvideo input capabilities and corresponding components that is located400 ft. away, and the second signal is combined with the first signal,which is then sent it to still another or third ICD that is 200 ft.away, and so on, providing an extended signal transmission from a seriesof wirelessly interconnected ICDs to provide an effective range ofsecurity surveillance over a larger target environment that is adistance additive of the range of each of the individual ICDscommunicating with each other and the DIR.

In another embodiment of the present invention, in particular whereinthe system has video capabilities, the system includes ICDs that areoperable to communicate with each other and/or the wireless DIR toexchange data and/or control each other to ensure that important datafrom ICD inputs is recorded properly with the DIR. By way of example, afirst ICD senses the motion of a person moving towards a second ICD andcommunicates instruction or directive to the second ICD to be aware ofthe motion sensed by the first ICD and to take appropriate action asprogrammed or set-up for that ICD, such as to record the sensed motion.The appropriate action may further include capturing and/or recordingthe inputs at an increased frame rate, an increased resolution, and/orother action to ensure that the important data, in this case motion, iscaptured or recorded by the second ICD.

In another embodiment of the present invention, in particular whereinthe system has video capabilities, the system includes ICDs that areoperable to communicate directly with each other and/or the wireless DIRto exchange data and/or control each other based on a set of rulescreated by the user. By way of example, a first ICD detects a firstmotion of a first object that is moving towards a second ICD; whereinthe first ICD has been programmed and/or set-up with a rule indicatingthat if motion moves from the first ICD to a second ICD, then an alarmmust be made. The first or second camera can send the alarm to the RSCas the ICDs can share rules with each other.

In another embodiment of the present invention, in particular whereinthe system has video capabilities, the system includes ICDs that areoperable to directly cross-communicate with each other and/or thewireless DIR to exchange data and/or control each other to ensuremaximum throughput at the appropriate ICDs. By way of example, a firstICD detects a first motion of a first object that is moving towards asecond ICD; wherein the first ICD has been programmed and/or set-up tosend a status signal to the second ICD to ensure that the second ICD hasthe throughput it requires to monitor the pending action.

In another embodiment of the present invention, in particular whereinthe system has video capabilities, the system includes ICDs that areoperable to communicate with each other and/or the wireless DIR toexchange data. Such data includes “content data” that is a separatestream of data from the video data. The ICDs and/or DIR work together tobecome a content management network whereby the content data is managed.By way of example, in a room monitored by an ICD, a person wearing a redsweater places a box on the floor, opens a door, and leaves. The ICDcould detect the following: (1) a moving mass that is the color red, theperson's sweater; (2) a movement in an otherwise steady mass, the door;and (3) a new mass now in the image, the box. In addition to the videoof the event, the ICD could store the content data of “a person wearingred left a box in the room and walked out the door.” This content datacan be shared with the DIR and/or other ICDs.

In another embodiment of the present invention, in particular whereinthe system has video capabilities, the system includes ICDs that areoperable to communicate with each other and/or the wireless DIR toexchange data and/or control each other based on a set of rules createdby the user. Such data includes “content data” that is a separate streamof data from the video data. The ICDs and/or DIR work together to becomea content management network whereby the content data is managed. By wayof example, in a room monitored by an ICD, a person wearing a redsweater places a box on the floor, opens a door, and leaves. The ICDcould detect the following: (1) a moving mass that is the color red, theperson's sweater; (2) a movement in an otherwise steady mass, the door;and (3) a new mass now in the image, the box. In addition to the videoof the event, the ICD could store the content data of “a person wearingred left a box in the room and walked out the door.” This content datacan be shared with the DIR and/or other ICDs. The content data maytrigger a rule, which could be set to issue an alarm if a mass is leftin the room, such as the box in the current example. The rule couldfurther include capturing and/or recording the ICD's inputs at anincreased frame rate, an increased resolution, and/or other action toensure that the important data, in this case the video of the new box,is captured or recorded by the ICD.

In another embodiment of the present invention, the at least one ICDincludes at least one video capture device or the ICD(s) have digitalvideo input capture capability and components functional for providingthe same; and the DIR includes digital video recording (DVR)capabilities and components functional for providing the same.Furthermore, the ICD(s) may be video camera(s) or provide such functionsimilar to video camera(s).

Additionally, microchip(s) within the ICD(s) provide intelligent inputcapture and learned pattern analysis, such as an ICD with videocapability identifying or sensing a mass of an object within itssurveillance range, comparing the input characteristics with referencedand/or learned information, labeling the sensed object based on a likelymatch in the referenced and/or learned information, communicating and/orreferencing programmed data to determine if other action is required,and performing the required action, as appropriate. By way of example, awireless digital camera senses a moving object within its targetsurveillance area, compares the size and shape of the object withreference information to determine that the moving object is likely aperson, checks rules or settings to determine whether sensing thepresence of a person is a trigger event for indicating an alarm, andcommunicating the alarm and/or recording and transmitting the imagesassociated with the moving object (person) to other ICD(s), the DVR,and/or the RSC. In another example, additional inputs such as RFIDinputs from tagged objects, identification badges, and the like, may beinputted to the ICD(s) and compared with reference information orsettings to activate (or not) a trigger event. Alternatively, theabsence of an RFID transmitter on a moving object (person) or stationaryobject (unauthorized package or object) in a secure area including thetarget surveillance environment may also be operable to activate atrigger event or alarm, and/or activate other sensors, such asradiation, sound, chemical detection, and the like, and combinationsthereof. By way of more detailed example, in the case of videosurveillance, where a person enters the target environment undersurveillance by the ICDs, and where the person has an employee badgewith an RFID or other transmitting capability, either active or passive,embedded or incorporated therein/on, the ICDs video capture identifiesthe RFID tag data and compares it with existing data or settings storedwithin the ICD(s). If the RFID tag data does not comport withpermissions available for and associated with that ID tag, then theICD(s) activates a trigger event, such as recording inputs includingvideo, audio, and other data associated with the person detected by theICD, such as, by way of example and not limitation, clothing color,direction of travel, mass, height, speed, whether the person is carryinganything, movement particulars like jerkiness or injury, and the like.The ICD(s) then cross-communicate to ensure that other ICDs are aware ofthe non-compliant detection by the first ICD so that they respondaccordingly. If the trigger event is an alarm event, then the ICDs areoperable to send notification directly to the DIR or through other ICDsto the DIR or RSC, such that corresponding alarm event actions occur,such as further third party notification and inputs recording asrequired or determined by settings or programming within the system. Inpreferred embodiments the ICDs are digital video cameras operable tocommunicate wirelessly with each other, the DIR, and/or the RSC.

In another embodiment according to the present invention, the ICDswithin the mesh network are further equipped with wireless communicationtransmitters, such as cellular phone transmitters or wide band cellularcards for providing cellular transmission/reception by each ICD, toprovide each ICD/camera with standalone capability to cross-communicatewith each other to extend the effective surveillance area and/or tocommunicate with each other to transmit and receive information that isfurther transmitted via the Internet to the RSC. Furthermore, businessmodels using such systems and components with this type of method ofoperation permit users to access the system and its inputs formonitoring after payment of a monthly service fee. If an authorized userhas paid the monthly subscription charge or service fee, then the usermay remotely access ICD inputs, including stored data, and can downloadthe stored or recorded input data through the RSC and/or a device inelectronic communication with the RSC.

SmartMesh ICDs/Cameras

A surveillance system for wireless communication between componentsincluding: a base system including at least two wireless input capturedevices (ICDs) and a remote server computer (RSC) having a display witha user interface, the RSC being operable to transmit and receiveinformation with the ICDs, the ICDs having at least one sensor and atleast one input component for detecting and recording inputs, amicroprocessor, a memory, a transmitter/receiver, all ICD componentsbeing constructed and configured in electronic connection; wherein theICDs are operable for wireless cross-communication with each otherindependent of the RSC for forming a mesh network of ICDs operable toprovide secure surveillance of a target environment; the user interfaceproviding a visual representation of captured data in an image formatand a contextualized image format comprising the visual representationof captured data and coordinated spatial representation of the imageformat.

Preferably, the coordinated spatial representation of the image formatincludes a coordinate system to provide a spatial context for thecaptured data, which includes narrow-scope context that is relatedspatially to the immediate surroundings, and/or a geospatial context forthe captured data, including more global or broad scope context that isrelated by GPS or other geographic-based coordinate systems. Thus, thepresent invention provides a 3-dimensional (3-D) geospatial view of thecaptured data.

In one embodiment, the coordinate system is an overlay for the visualrepresentation of the captured data. In this case, the coordinate systemprovides context without visually depleting or diminishing theinformation provided by the two-dimensional or image-based captured dataand its representation on the user interface.

In another embodiment, the coordinate system creates a 3-dimensionalview of the 2-dimensional (2-D) image by providing relational spatialimaging of the surrounding environment or context of the image.Preferably, the 2-D image is visually represented as more linearly thanthe image itself, with the target or key aspects of the captured dataand/or image being substantially represented in the same manner as inthe 2-D image view. The target captured data may be the sensed image orobject by the ICD(s), depending upon the sensors and relatedfunctionality. By way of example, the target image may be a person whosepresence is detected by motion sensors on the ICD. In any case, the 2-Dimage may be an image itself, such as a digital photographic image, astill frame of a video image, a rendering of the actual image and/ordata captured by the ICD(s), and combinations thereof.

In a preferred embodiment, the system is operable to provide comparable2-D and 3-D images as set forth in the foregoing.

FIG. 11 illustrates via schematic diagram the ICD or camera 30 that isoperable to receive or capture 2-D data from a target or surveillanceenvironment, wherein the ICD is operable in wireless communication withanother (or several) ICD that communicates with the DVR 10 that is innetworked or wireless communication with the remote server computer(RSC) and/or via the internet to communicate electronically the captureddata and corresponding visual representations thereof to a displayhaving a user interface on a device in communication with the RSC, suchas a video-enabled cellular or wireless communication device or phone,other computers or wireless devices.

FIG. 12 provides a visual user interface view on a display with the 2-Dimage data on the left side of the screen or display and the 3-D imageof the same captured data with the target image (the person) retainingsubstantially all of the visual or photographic-type image data withinthe context of the spatial coordinate system shown by the lines withinthe right side of the display. Additional data relating to the targetimage or sensed object (in this example, the person) is also provided tosupplement the visual image and coordinate context of the display.

ICDs and/or cameras which have the ability to capture video and audioand/or 3D data about an area of interest and/or data from sensors thenanalyze the video and/or the 3D data and/or the sensor data to determineamong other things how many people are in an area of interest, how muchtime they spent in an area, what direction they traveled, how tall theyare, exactly where they are in a 3 dimensional space, their gestures andphysical behavior (to determine and predict human behavior andintentions), RFID data, bar code data, and any other sensor data such astemperature and humidity data as well as analyze the video and/or the 3Ddata and/or the sensor data to determine if there are objects in thearea which are new or are different (were removed from the area or movedinto the area) such as boxes, cars, equipment, and object RFID or otherdata such as Bar Code data. Then upon analyzing that data, the cameracan optionally make decisions on that data based on rules that arestored in a database in the camera.

These rules in the ICD(s) or smart camera(s) are provided from the DVMand/or another smart camera and are operable to be changed automaticallyat anytime or upon demand by an authorized user of the system.

The camera transmits the data and optionally the decisions and/or thevideo and audio associated with that data wirelessly (using networkprotocols such as 802.11, cell phone protocols such as CDMA or GSM, orany other wireless protocol such as Zigbee, Bluetooth, or other) to aDVM and the DVM can store the data, report on the data and take furtheractions on that data.

The camera can optionally transmit the data and the decisions and/or thevideo and audio associated with that data wirelessly using networkprotocols such as 802.11, cell phone protocols such as CDMA or GSM, orany other wireless protocol such as Zigbee, Bluetooth, or other) toanother camera which can take that data and combine it with its own datato make unique decisions based on the combination of the two data sets.Then the camera can send the combined data sets and optionally thedecisions and/or video associated with that data wirelessly or wired toanother camera to make further unique decisions on combined data.

The present invention provides for systems and methods having a 3D modelof a space provides a 3D context for the inputs from the ICDs; inputsfrom the ICDs, including direct cross-communication information,location, settings, environment conditions, and inputs (video, audio,temperature, other sensors, object patterns, movement of a multiplicityof objects and/or people, and analytics related to the objects and/orhuman patterns, including visual patterns, predetermined movements orgestures, facial recognition, and combinations thereof), being visuallyrepresented on a GUI independently and in the 3D context forsimultaneous display of all the info, and analytics based on the info,including activity density within the 3D context based on the inputs,for surveillance and analysis of target environment(s).

No prior art provides for custom analytics that are relevant to theenvironment as in the present invention. By way of example, in a retailapplication, it's not about just tracking an individual who might beshoplifting or tampering with goods but the relevance is based onpredetermined events or situations, like build-up of customers atspecific 3D locations (like lines at check-out, lines at customerservice, the deli counter, special advertisement or presentation ofarticles in different location to judge traffic/marketing/presentation,the emergency exit, etc.) wherein specific indications (analytics) wouldresult (indication of need to open another register, notify additionalcustomer service reps., more deli people, success of a promotionalevent/packaging change, etc.). This is an “activity density” or “contentdensity” feature and functionality unique to the present invention.Furthermore, other behavior of humans, including but not limited togestures, actions, changes in actions, patterns of behavior, facialrecognition, age, sex, physical characteristics, and combinationsthereof, are preferably included with the 3-D visual representation ofthe inputs and the analysis relating thereto. More preferably, theanalysis and indication of predetermined patterns, activities,movements, speed, etc. are included simultaneously with the video inputsand their 3-D contextualization to provide for situational awareness andanalysis automatically based upon the inputs and context thereof.

One aspect of the present invention is to provide systems and methodsfor analytics displays and management for information generated fromvideo surveillance systems, including contextualization and remotereview.

Another aspect of the present invention is to provide systems andmethods for analytics displays and management for information generatedfrom direct cross-communication from independent input capture devices(ICDs), wherein the information includes contextualization and remotereview of inputs from the ICDs, the inputs being directly associatedwith the ICD(s) that originated them, and settings associated with eachof the ICDs and information associated with the ICD settings (date,time, environment conditions, etc.) and the inputs (direct correlation).

Another aspect includes the addition of interactive 3D visualizationremotely through a network on a remote computer having a display and agraphic user interface (GUI) viewable by a remote user. Preferably thisremote user GUI provides a true 3D interface for simultaneouslypresenting input information and additional ICD-based information(including but not limited to ICD identification, position, settings,environment conditions, etc.) and an interactive 3D perspective of theICD and its 3D physical context, thereby providing at least three levelsof analytics and visual input information for multi-level processing ofthe surveillance environment.

A smart mesh network surveillance system and method for providingcommunication between a base system having at least one wireless inputcapture device ICD(s) and other ICD(s), wherein the ICD(s) are capableof smart cross-communication with each other and remote access to theirinputs via a server computer, including the steps of providing this basesystem; at least one user accessing the ICDs and inputs remotely via auser interface through a remote server computer and/or electronic devicecommunicating with it, wherein the captured data is represented visuallyon a user interface or screen views for the user, the screen viewsshowing 2-dimensional data and corresponding 3-dimensional data of thesame input capture with coordinate overlay to provide a geographiccontext for the captured data. The present invention uses theaforementioned systems and methods for providing a 3D model of a spaceprovides a 3D context for the inputs from the ICDs; inputs from theICDs, including direct cross-communication information, location,settings, environment conditions, and inputs and analysis thereof, beingvisually represented on a GUI independently and in the 3D context forsimultaneous display of all the info, and analytics based on the info,including activity density within the 3D context based on the inputs,for surveillance and analysis of target environment(s).

Advantageously, this provides for action or response based on the 3Dcontextualized inputs and the various views, including but not limitedto 3D geospatial overlay and interactivity to shift perspective withinthat 3D context.

FIGS. 13-15 provide perspective views of video analytics display on avideo surveillance camera device, in accordance with an embodiment ofthe present invention. Examples of the visual display are provided inthe illustrations on the actual camera or video input device directly(such as FIG. 13 showing the video recorder and camera status on a frontside of the device itself, on a small screen). Information orientationis preferably adjustable or automatically adaptable, based upon deviceorientation, so that a user can easily review the information or text ina proper orientation (i.e., vertically). In an alternate embodiment,this camera status and recorder status information may be viewable on aremote screen that is in wireless communication with the device(s), forexample on a handheld electronic device such as a mobile phone or PDA.

FIGS. 16-20 show perspective views of the data analytics managementsystem for video surveillance information, including remote displayscreen shots illustrating contextualization features. Videocontextualization is selective adopted by the user, preferably through aremote, network-based access. That visualization is functional andoperable to be manipulated by a user to provide a visual perspectivethat optimizes data and information review, without eliminating datacontent provided by the input from the digital video surveillancesystem. By way of example and not limitation, the interactive GUIincludes analytics about the target environment, based upon visualpatterns. In one demonstrative case, this may include visual patternsthat are automatically detected in a predetermined environment, such asa retail space. In this setting, automatic notification of a pattern,such as a grouping of a multiplicity of moving objects, like peoplequeuing at a check-out counter, triggers automatic notification that acorresponding action should be taken, such as opening another check-outline to eliminate the queue quickly. In another example, marketinganalytics may be obtained by visual patterns in a 3-D environment, suchas traffic around a display in a retail setting; changing displayconfiguration and positioning and the corresponding change in visualpattern detectable automatically in that environment can be comparedusing the systems and methods of the present invention.

Certain modifications and improvements will occur to those skilled inthe art upon a reading of the foregoing description. All modificationsand improvements have been deleted herein for the sake of concisenessand readability but are properly within the scope of the claims.

1. A surveillance system for wireless communication between componentscomprising: a base system including at least two wireless input capturedevices (ICDs) and a remote server computer (RSC) having a display witha user interface, the RSC being operable to transmit and receiveinformation with the ICDs, the ICDs having at least one sensor and atleast one input component for detecting and recording inputs, amicroprocessor, a memory, a transmitter/receiver, all ICD componentsbeing constructed and configured in electronic connection; wherein theICDs are operable for wireless cross-communication with each otherindependent of the RSC for forming a mesh network of ICDs operable toprovide secure surveillance of a target environment; and an interactivegraphic user interface (GUI) providing a visual representation ofcaptured data in an image format and a contextualized image formatcomprising the visual representation of captured data and coordinatedspatial representation of the image format, wherein the coordinatedspatial representation of the image format comprises a coordinate systemto provide a geospatial context for the captured data.
 2. The system ofclaim 1, wherein the visual representation of the captured data ispresented as an interactive 2-dimensional view.
 3. The system of claim2, wherein the 2-dimensional view is an image.
 4. The system of claim 2,wherein the image is a still frame of a video image.
 5. The system ofclaim 1, wherein the coordinate system provides an interactive3-dimensional geospatial view of the captured data.
 6. The system ofclaim 1, wherein the inputs include video.
 7. The system of claim 1,wherein the cross-communication of ICDs includes data exchange, whereinthe data exchange includes information about the surveillanceenvironment, settings, inputs, and combinations thereof.
 8. The systemof claim 1, wherein the ICDs are operable to transmit inputs from oneICD to other ICDs, which are configured and operable to communicate witheach other to provide a maximum extended range of a surveillance area.9. The system according to claim 1, wherein the ICDs are operable tocompare inputs to reference data for labeling a sensed object forfurther identification by the system.
 10. The system according to claim1, wherein the interactive GUI includes analytics about the targetenvironment, based upon visual patterns.
 11. A method for providingnetworked communication in a base system including at least one wirelessinput capture device ICD(s) and a corresponding digital input recorder(DIR) or another ICD forming a base system wherein the ICD(s) arecapable of direct smart cross-communication with each other and whereina user is provided access to the ICD inputs via a remote server computer(RSC) having a display with a user interface, comprising the steps of:providing the base system; providing remote access to the DIR or ICD(s)via the remote server computer; the ICD(s) being operable to process theinputs based upon predetermined settings stored in a memory of the ICDand to directly communicate with each other to transmit input data tothe RSC; representing captured data from the ICDs visually on a graphicuser interface (GUI) for a remote user, the user interface includingviews showing 2-dimensional data and corresponding 3-dimensional data ofthe same input capture, wherein the 3-dimensional data comprises acoordinate overlay for providing a geospatial context for the2-dimensional data, and wherein the GUI is interactive so that theremote user can dynamically change the perspective viewable through theGUI.
 12. The method of claim 1, wherein the 2-dimensional data is animage.
 13. The method of claim 2, wherein the image is a still frame ofa video image.
 14. The method of claim 1, wherein the input captureincludes video.
 15. A method for providing networked communicationbetween at least two wireless input capture devices (ICDs) capable ofwireless cross-communication, data processing, and communication with aremote server computer (RSC), the ICDs forming a base system, comprisingthe steps of: providing the base system; at least one user accessing theat least one ICD through the RSC via a user interface; the ICD(s)establishing direct, smart cross-communication with each otherindependent of the RSC to provide a secure wireless surveillance systemfor a target environment; providing a visual representation of thecaptured data on the user interface in an image format; andcontextualizing the image format with a coordinate system to provide ageospatial context for the captured data, wherein the contextualizationincludes an interactive 3D model of a space that provides a 3D contextfor the inputs from the ICDs.
 16. The method according to claim 15,wherein the base system further includes a wireless digital inputrecorder (DIR) operable for wireless communication with the ICDs. 17.The method according to claim 15, wherein the inputs from the ICDs,including direct cross-communication information, location, settings,environment conditions, and inputs are visually represented on aninteractive graphic user interface (GUI) independently and in the 3Dcontext for simultaneous display of all the info, and analytics based onthe inputs.
 18. The method of claim 15, wherein the inputs and analyticsfurther include activity density within the 3D context based on theinputs.
 19. The method according to claim 15, further including the stepof the ICDs transmitting inputs directly from one ICD to other ICDsconfigured and operable to communicate with each other to provide amaximum extended range of a surveillance area.
 20. The method accordingto claim 15, wherein the user is capable of accessing the ICDs via auser interface either directly or remotely through the RSC.